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METHOD AND APPARATUS FOR REMOTE PROCESSING OF 

IMAGE DATA 

BACKGROUND OF THE INVENTION 

The present invention relates generally to the remote processing and/or review 
of image data. More specifically, the present invention relates to the remote 
processing and/or review of image data acquired by non-invasive imaging systems, 
such as those used in medical imaging or for security screening. 

A wide variety of medical imaging technologies, such as digital X-ray, 
tomosynthesis. X-ray mammography, computed tomography (CT), positron emission 
tomography (PET), electron beam tomography (EBT), magnetic resonance imaging 
(MRI), and so forth, have become commonplace at both large and small medical 
facilities. These imaging technologies are typically capable of non-invasively 
acquiring image data of an anatomic region of interest. The image data may typically 
be processed to generate two-dimensional images or three-dimensional models 
representing the surface or interior features of the anatomic region of interest. 

Typically, a referring physician, who may have little or no training in 
analyzing or reading radiological images, will refer a patient for diagnostic imaging. 
A technologist may perform the image acquisition of the patient using the desired 
imaging technology. The technologist may then process the image data to generate 
the two-dimensional images and/or three-dimensional models based upon the acquired 
image data. Due to the relative scarcity of trained technologists and the proliferation 
of imaging technologies, however, the time or expertise for proper processing may be 
at a premium. It may therefore be desirable to find techniques to facilitate or share the 
processing of the image data. 

The radiologist, who is typically specialized in the imaging technology and/or 
the anatomical region of interest, analyzes or "reads" the processed image data. The 
radiologist typically reads the image data at a review workstation, which may or may 
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not be near the imaging system and/or the referring physician. The radiologist may 
dictate plain, text descriptions of her diagnostic conclusions at the time she reads the 
image data. The dictated comments may then be provided to the referring physician, 
typically with the image data to which they relate, who may then counsel the patient 
5 regarding any diagnostic findings. 

As may be expected, the patient outcome may depend on the speed and quaUty 
of the diagnosis and on the communication of the diagnosis and associated factors 
from the radiologist to the referring physician and to the patient. For example, in 

10 routine situations, such as patient office visits, the ability of the referring physician to 

communicate the diagnosis to the patient may be essential for behavior modification 
which may improve the patient's health. The quality of the diagnosis and the speed 
and effectiveness with which it is communicated to the referring physician is therefore 
an important part of the i maging p rocess. F acilitating o r i mproving t he d iagnostic 

15 process and/or the communication process may therefore be important goals in patient 

treatment. 

BRIEF DESCRIPTION OF THE INVENTION 

The present invention relates generally to providing for the remote processing 
20 and/or review of imaging data. A collaborative imaging system is provided by which 

a remote technologist may perform all or part of the post-processing of a set of image 
data, allowing the local technologist to perform examinations more rapidly. 
Alternatively, the collaborative imaging system may allow a referring physician and 
radiologist to review a processed set of image data in a collaborative manner, such as 
25 using a common desktop or screen, and with real-time, dynamic communications. 

Similarly, other radiologists, technologists, or other experts may collaboratively view, 
analyze, or process the image data sets as desired, allowing the expertise of multiple 
radiologists and/or technologists to be applied to an image data set in a concurrent or 
collaborative manner. 

30 
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In accordance with one aspect of the present technique, a method for 
collaboratively h andling an image data set is provided. In the present technique, a 
collaborative session is initiated on an application server connected to a network. One 
or more collaborative workstations on the network are joined to the collaborative 
5 session, such that the one or more collaborative workstations and the application 

server comprise participating nodes of the collaborative session. One or more routines 
stored on the application server are provided to the participating nodes. The one or 
more routines are useful for at least one of processing and analyzing an image data set. 
Systems and computer programs that afford functionality of the type defined by this 
1 0 method are also provided by the present technique. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other advantages and features of the invention will become 
apparent upon reading the following d etailed d escription and upon reference to the 
1 5 drawings in which: 

Fig. 1 is a general diagrammatical representation of certain ftmctional 
components of an exemplary generic imaging system configured for remote operation 
via the present technique; and 

20 

Fig. 2 is a block diagram of certain functional components of a collaborative 
imaging system in accordance with the present technique. 

DETAILED DESCRIPTION OF SPECIFIC EMBODIMENTS 

25 Turning now to the drawings, and referring first to Fig. 1, an exemplary 

collaborative imaging system 10 suitable for use in a medical context is depicted. 
Generally, the collaborative imaging system 10 includes some type of imager 12 that 
may operate in accordance with various physical principles for creating image data. Li 
general, the imager 12 creates image data representative of regions of interest in a 

30 patient 14 either in a conventional support, such as photographic film, or in a digital 

medium. 
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The imager 12 operates under the control of system control circuitry 16. The 
system control circuitry 16 may include a wide range o f circuits, such as radiation 
source control circuits, timing circuits, circuits for coordinating data acquisition in 
conjunction with patient or table movements, circuits for controlling the position of 
radiation sources and detectors, and so forth. In the present context, the system 
control circuitry 16 may also include memory elements for storing programs and 
routines implementing the techniques described herein which may be executed by the 
system control circuitry 16 or by associated components of the collaborative imaging 
system 10. 

The imager 12, following acquisition of the image data or signals, may process 
the signals, such as for conversion to digital values, and forward the image data to 
data acquisition circuitry 18. In the case of analog media, such as photographic film, 
the data acquisition system m ay g enerally include supports for the film, as well as 
equipment for developing the film and producing hard copies that may be 
subsequently digitized. For digital systems, the data acquisition circuitry 18 may 
perform a wide range of initial processing fixnctions, such as adjustment of digital 
dynamic ranges, smoothing or sharpening of data, as well as compiling of data 
streams and files, where desired. The data may then be transferred to data processing 
circuitry 20 where additional processing and analysis are performed. For conventional 
media such as photographic film, the data processing system may apply textual 
information to films, as well as attach certain notes or patient-identifying information. 
For the various digital imaging systems available, the data processing circuitry 20 
perform substantial analyses of data, ordering of data, sharpening, smoothing, feature 
recognition, and so forth, which facilitate the generation of a usefiil set of image data. 
The data processing fimctions may be performed, in general, under the guidance of 
one or more technologists. The acquired images or image data may be stored in short 
or long-term storage devices, such as a picture archiving communication system 
(PACS) 22. 
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The above-described operations and functions of the collaborative imaging 
system 10 may be controlled by a scanner console 24, which typically interfaces with 
the system control circuitry 16. T he s canner c onsole 2 4 m ay i nclude o ne o r m ore 
general purpose or application specific computers 30 or processor-based components. 
The scanner console 24 may include a monitor 32 or other visual display and one or 
more input devices 34. The monitor 32 and input devices 34 may be used for viewing 
and inputting configuration information or for operating aspects of the collaborative 
imaging system 10, in accordance with the techniques discussed herein. As with the 
system control circuitry 16, the scanner console 24 may comprise or communicate 
with a memory or data storage component for storing programs and routines 
implementing the techniques described herein which may be executed by the scanner 
console 24 or by associated components of the collaborative imaging system 10. 
Moreover, the memory or storage component may comprise one or more memory 
devices, such as magnetic or optical drives, of similar or different types, which may be 
local or remote firom one another. 

It should be noted that more than a single scanner console 24 may be provided. 
For example, an imaging scanner or station may include a console which permits 
regulation of the parameters involved in the image data acquisition procedure, 
whereas a different scanner console may be provided for manipulating, enhancing, and 
viewing resulting reconstructed images. 

In addition, a remote console 26 may communicate with other components of 
the collaborative imaging system 10, such as via a network 28. As will be appreciated 
by those skilled in the art, any suitable circuitry, such as modems, servers, firewalls, 
VPN's and so forth may be included within the network 28. For example, the network 
28 may include one or more of a local intranet within the medical facility, a service 
network between the facility and a service provider, a direct communication line 
between the local and remote components of the collaborative imaging system 10, a 
virtual private network established over the Intemet, the Internet itself, and so forth. 
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The remote console 26 may comprise many, if not all, of the components of 
the scanner console 24, such as a monitor 32 and input devices 34. The remote 
console 26 allows a remote operator to access other elements of the collaborative 
imaging system 10 via the network 28. For example, the remote console 26 may 
comprise a PACS workstation or other interface that may be used to access the stored 
or acquired image data from a remote location. As such, the remote console 26 may 
be used by a technologist who may assist in the processing of acquired imaging data, a 
radiologist who reads the acquired or processed imaging data, a referring physician 
who refers to the analyzed images for patient consultation, and so forth. 

In general, the collaborative imaging system 10 provides for collaborative 
sessions to initiated or joined from the various nodes on the network, such as at the 
scanner console 24, PACS Server 22, and/or remote consoles 26. Li practice, the 
collaborative environment may be established using various techniques that allow for 
the concurrent review and/or operation of all or part of a common screen or user 
interface from each participating node. For example, the software rendering and 
visualization tools used by the technologist and/or radiologist may be provided to the 
various participating nodes, allowing operators at those nodes to concurrently view, 
modify, or process an image data set during the collaborative session. Furthermore, 
operators at the different nodes joined in a collaborative session may be in 
communication with one another during the session, such as over a separate voice 
line, over the network via text-based messaging, or over the network using an audio 
protocol, such as Voice-over-Internet (VOI). In addition, participants to a 
collaborative session may attach or share multimedia objects that may be retrieved 
and/or played by other session participants. 

An exemplary representation of a collaborative network environment is 
depicted in Fig. 2. As depicted in Fig 2, a number of participating nodes 40 may be 
present on a network 28 during a collaborative session. The nodes 40 may be a 
standalone computer workstation, such as a remote console 26, a scanner console 24, 
or a PACS server 22. One such node 40 may run an appUcation server 42 routine that 
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enables or runs the collaborative session. The remaining nodes, represented as 
collaborative workstations 44, may join the session running on the application server 
via the network 28. When joined to the session, the collaborative workstations 44 
may concurrently view all or part of the image data set using software rendering or 
visuaUzation tools shared through the application server 42. 

In one example of a collaborative imaging environment, the application server 
42 routine is run on a node that contains an image data set, typically the scanner 
console 24 or PACS Server 22, The collaborative workstations 44 may be configured 
as thin clients that may communicate with the application server 42 to initiate, 
terminate, join, or detach from a collaborative session as desired. As one of ordinary 
skill in the art will appreciate, multiple collaborative sessions may concurrently exist, 
depending on the network protocols employed and the available bandwidth. 
Likewise, the collaborative session may be configured such that collaborative 
workstations 44 may join or detach from an ongoing collaborative session without 
disturbing the state of the session. In particular, the collaborative session provides 
framebuffer communication with sufficient image quality for diagnostic review and 
analysis at the participating nodes. In one possible implementation of this example, 
the collaborative imaging environment may be based on the remote framebuffer 
(RFB) protocol for sharing graphical framebuffers and a muUicasting audio 
connection based on network socket inter-process communication (IPC). 

The collaborative workstations 44 may be configured as thin clients to prevent 
or minimize undesired operator modifications. The thin client configuration may 
encompass personal computers (PCs) with little or no mass storage capability or with 
management controls placed on the operating system to prevent local operator 
alteration. Similarly, the thin client configuration may encompass network computers 
(NCs), which typically function as a terminal for a mainframe type system, a web 
browser, and Java engine capable of executing programs or applets written in Java. 
Other arrangements that may be construed as thin client configurations are possible. 
Generally, however, a thin client configuration may be construed as one in which the 
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thin client system is not subject to local manipulation or customization by an operator 
other than to execute one or more programs retrieved from an application or data 
server. 

Because of these types of constraints, collaborative workstations 44 configured 
as thin clients might load the program or programs to be run from the application 
server 42. Similarly, changes made at a collaborative workstation 44 might be saved 
at the application server, presumably the scanner console 24 or PACS system 22. Li 
this manner, the collaborative workstations 44 could have shared concurrent access to 
the same visualization software and tools as well as to the image data set of interest. 

One use of a collaborative imaging system 10 will be discussed with reference 
to Fig. 1 once again. Li particular, a local technologist working at the scanner console 
24 may process patients according to a schedule, which may leave insufficient time 
for the local technologist to post-process the acquired image data using the desired 
processing routines available on the application server 42. Such post-processing 
routines may, among other things, process the data into suitable two-dimensional 
slices or three-dimensional renderings, apply one of more computer assisted detection 
or diagnosis algorithms, segment features of interest, correct image artifacts, and 
remove bone or soft tissue. 

In the context of a collaborative imaging session, the scanner console 24 or the 
PACS System 22 may be configured as an application server 42 hosting a 
collaborative session. One or more remote technologist on respective collaborative 
workstations 44, such as the remote consoles 26, may then join the session and post- 
process the acquired image data for a patient, either in conjunction with or instead of 
the local technologist. The local technologist may then have more available time to 
process patients, frideed, the local technologist may focus exclusively on acquiring 
patient data while remote technologists process the acquired data in either sequential 
or concurrent sessions. Li this manner, the remote technologists may service more 
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than one patient site if desired, with each remote technologist able to provide support 
as she becomes available to the next patient site requiring assistance. 

Furthermore, the local technologist may refer an image data set to an expert in 
5 the particular anatomical region or of the particular imaging modality, such as 

magnetic resonance imaging, mammography, computed tomography, and so forth. In 
this implementation, problem image data sets or those image data sets outside the 
expertise of the local technologist may be referred to one or more remote 
technologists for expert processing. In this maimer, expert image processing may be 
10 provided without keeping an expert on-site. Conversely, an expert technologist may 

provide support as a remote expert for more than one imaging site. As noted above, in 
these implementations, the voice or text communications may be provided between 
the local and remote technologists, over the network 28 or otherwise, to facilitate 
concurrent processing, instruction, or interpretation. 

15 

In another implementation, a radiologist and referring physician may 
participate in a collaborative session regarding the patient of the referring physician. 
For example, referring once again to Fig. 1 , the radiologist and referring physician 
may both use respective remote consoles 26 to join a collaborative session running on 

20 an application server, such as on the scanner console 24 or the PACS system 22. 

During this collaborative session, the radiologist and the referring physician may 
concurrently review the images and/or volumes using software rendering and/or 
visualization tools available from the application server 42. In addition, one or more 
technologists may participate in the collaborative session. In this manner, the 

25 radiologist may dynamically convey her diagnosis with appropriate reference to the 

images when desired. Similarly, the referring physician may ask questions of the 
radiologist and elicit responsive comments during the collaborative session. The 
referring physician may thereby obtain a timely and suitably responsive diagnosis, 
allowing him to appropriately counsel the patient. Furthermore, if desired additional 

30 radiologists and/or technologists may join the collaborative session on their respective 
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collaborative workstations 44, such as remote consoles 26, providing additional 
feedback and/or diagnosis. 

While the present technique has been discussed with regard to medical 
imaging, it may also be applied to other imaging contexts in which the imaging data 
may be processed and/or analyzed to determine structure or featvires of interest. For 
example, security screening, such as baggage, package, or passenger screening, may 
benefit from the present technique. In the security context, image data may be 
acquired and reviewed by a screener to determine the presence of illicit material. A 
collaborative imaging environment may allow local personnel to focus on the flow of 
passengers or packages during busy periods while remote personnel handle excess or 
spillover image data. Likewise, equivocal or unclear image data may be reviewed or 
analyzed by screeners with more experience or specialized knowledge, allowing for 
the faster and more accurate analysis of the data. As one of ordinary skill in the art 
will readily apprehend, other imaging contexts and modalities may also benefit from 
the present technique. 

While the invention may be susceptible to various modifications and 
alternative forms, specific embodiments have been shown by way of example in the 
drawings and have been described in detail herein. However, it should be understood 
that the invention is not intended to be limited to the particular forms disclosed. 
Rather, the invention is to cover all modifications, equivalents, and alternatives falUng 
within the spirit and scope of the invention as defined by the following appended 
claims. 



10 



